Improving Spatiotemporal Inpainting with Layer Appearance Models
نویسندگان
چکیده
The problem of removing blemishes in mosaics of building facades caused by foreground objects such as trees may be framed in terms of inpainting. Affected regions are first automatically segmented and then inpainted away using a combination of cues from unoccluded, temporally adjacent views of the same building patch, as well as surrounding unoccluded patches in the same frame. Discriminating the building layer from those containing foreground features is most directly accomplished through parallax due to camera motion over the sequence. However, the intricacy of tree silhouettes often complicates accurate motionbased segmentation, especially along their narrower branches. In this work we describe methods for automatically training appearance-based classifiers from a coarse motion-based segmentation to recognize foreground patches in static imagery and thereby improve the quality of the final mosaic. A local technique for photometric adjustment of inpainted patches which compensates for exposure variations between frames is also discussed.
منابع مشابه
Improving Consistency and Correctness of Sequence Inpainting using Semantically Guided Generative Adversarial Network
Contemporary benchmark methods for image inpainting are based on deep generative models and specifically leverage adversarial loss for yielding realistic reconstructions. However, these models cannot be directly applied on image/video sequences because of an intrinsic drawbackthe reconstructions might be independently realistic, but, when visualized as a sequence, often lacks fidelity to the or...
متن کاملPCA-Based Recognition for Efficient Inpainting
We present a technique for efficiently constructing a “clean” texture map of a partially occluded building facade from a series of images taken by a moving camera. After a robust registration procedure, building regions blocked by trees, signs, people, and other foreground objects are automatically inferred via the median absolute deviation of colors from different source images mapping to the ...
متن کاملSpatiotemporal Kriging with External Drift
In statistics it is often assumed that sample observations are independent. But sometimes in practice, observations are somehow dependent on each other. Spatiotemporal data are dependent data which their correlation is due to their spatiotemporal locations.Spatiotemporal models arise whenever data are collected across bothtime and space. Therefore such models have to be analyzed in termsof thei...
متن کاملVideo Inpainting
This Video inpainting is an important video enhancement technique used to facilitate the repair or editing of digital videos. In this paper, we propose a video inpainting algorithm for repairing damaged content in digitized video films, focusing on maintaining good spatiotemporal continuity. The proposed algorithm utilizes key techniques.
متن کاملTexture Modeling with Convolutional Spike-and-Slab RBMs and Deep Extensions
We apply the spike-and-slab Restricted Boltzmann Machine (ssRBM) to texture modeling. The ssRBM with tiled-convolution weight sharing (TssRBM) achieves or surpasses the state-of-the-art on texture synthesis and inpainting by parametric models. We also develop a novel RBM model with a spikeand-slab visible layer and binary variables in the hidden layer. This model is designed to be stacked on to...
متن کامل